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ABSTRACT 


All  known  globally  convergent  Iterations  for  the  solution  of  a nonlinear 
operator  equation  f(x)  * 0 are  either  non- stationary  or  use  nonlinear  informa- 
tion. We  ask  whether  there  exists  a globally  convergent  stationary  iteration 
which  uses  linear  information.  We  prove  that  even  if  global  convergence  is 
defined  in  a weak  sense,  there  exists  no  such  Iteration  for  as  simple  a class 
of  problems  as  the  set  of  all  analytic  complex  functions  having  only  simple 
zeros.  We  conjecture  that  even  for  the  class  of  all  real  polynomials  which 
have  real  simple  zeros  there  does  not  exist  a globally  convergent  stationary 
iteration  using  linear  information. 
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1.  INTRODUCTION 

Suppose  we  solve  a nonlinear  operator  equation  f(x)  * 0 by  an  iteration 
which  constructs  a sequence  of  approximations  For  most  convergence 

theorems  it  is  assumed  that  f is  sufficiently  smooth  and  starting  points 
are  "sufficiently  close"  to  a solution  or.  In  practice  it  is  very  hard  to 
verify  the  second  assumption.  One  therefore  wants  to  use  iterations  which 
are  globally  convergent. 

All  known  globally  convergent  iterations  are  either  non- stationary  or 
use  nonlinear  information.  For  instance,  Laguerre's  iteration  (see  for 
instance  Ralston  and  Rabinowitz  [78])  is  globally  convergent  for  the  class 
of  all  real  polynomials  having  only  real  zeros.  However  this  iteration 
uses  the  degree  of  the  polynomial  whose  zero  is  approximated.  This  means 
that  Laguerre's  iteration  uses  nonlinear  information  (see  Section  6).  An 
example  of  a non- stationary  iteration  using  linear  information  which  is 
globally  convergent  for  analytic  operator  equations  may  be  found  in  Traub 
and  Wozniakowski  [76]. 

However,  most  commonly  used  iterations  are  stationary  and  use  linear 
information.  Therefore  it  is  important  to  know  whether  there  exist  globally 
convergent  stationary  iterations  which  use  linear  information.  In  this 
paper  we  prove  that  for  as  simple  a class  of  problems  as  the  set  of  all 
analytic  complex  functions  with  simple  zeros  there  exists  no  such  iteration. 
We  conjecture  that  the  same  negative  result  holds  even  for  the  class  of  all 
real  polynomials  having  real  simple  zeros. 

We  summarize  the  contents  of  the  paper.  In  Section  2 we  remind  the 
reader  of  the  definitions  of  information  and  stationary  iteration  without 


1.2 


memory.  In  Section  3 we  discuss  Che  concept  of  global  convergence.  In 
Section  4 we  show  that  no  stationary  Iteration  without  memory  which  uses 
linear  information  can  be  globally  convergent  for  the  class  of  all  analytic 
complex  functions.  In  Section  5 we  extend  this  result  to  all  stationary 
iterations  with  or  without  memory  using  linear  information.  In  Section  6 
we  pose  a conjecture  that  for  the  class  of  all  real  polynomials  with  real 
simple  zeros  there  does  not  exist  a globally  convergent  stationary  iteration 
using  linear  information. 


2.1 


2.  STATIONARY  ITERATIONS  WITHOUT  MEMORY 

We  recall  the  definition  of  information  and  stationary  Iteration.  See 
Traub  and  Woz'niakowski  [78],  For  the  reader's  convenience,  in  Sections  2 
to  4 we  deal  only  with  one-point  iterations  without  memory.  The  extension 
to  the  general  case  is  given  in  Section  5. 

Consider  the  solution  of  a nonlinear  scalar  equation 

(2.1)  f (x)  - 0 

for  f 6 3 where  3 is  a subset  of  a spacq  H of  functions  f : c (L  -*  ([  . To 

solve  (2.1)  iteratively  we  need  to  know  something  about  f.  Let 

L . : D c H X (E  -*  (E  be  a functional  which  is  linear  with  respect  to  the 
l 

first  argument,  i.e., 

Li^Clf 1+C2f2’x^  * c1Li(f1»x)  + c2Li(f1,x)  whenever  x € Df  D Df  , 1*1,2 n. 

Consider  the  linear  information  operator  c H X <E  -*  C”.  defined  as 

(2.2)  3t(f,x)  - [L1(f,x),L2(f,x),...,Ln(f,x) ],  Vf  € H,  Vfx  € Df. 

Let  Xq  be  an  approximation  of  a solution  of  (2.1).  Let  cp:  c <Ltv+1  -»  <£ 

be  a functional.  We  construct  the  sequence  of  approximations  x^  by  the 
formula 

(2*3)  xi+1  " 9(^5  2l(f,xt)). 

The  functional  cp  is  called  a one- point  stationary  iterative  operator  without 
memory  using  a linear  information  operator  31.  For  brevity  cp  is  called  an 


iteration.  Let  $(9t)  be  the  class  of  all  such  iterations. 
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Note  Chat  most  iterations  use  values  of  f and  its  derivatives.  A 
linear  information  operator  is  a generalization  of  this.  For  example,  the 
information  operator  used  by  Newton  iteration 

Xi+1  " xi  ' 

is  9l(f,x)  ■ [f  (x)  ,f ' (x)  ].  This  operator  is  linear  and  cp  € $(9t). 


3.1 


3.  WHAT  DO  WE  MEAN  BY  GLOBAL  CONVERGENCE? 

Let  3 be  the  class  of  all  functions  f,f:  c C -»  G , analytic  in 

and  having  only  simple  zeros.  Let  S(f)  be  the  set  of  all  zeros  of  f. 

Consider  any  iteration  cp  6 $,  where  $ is  the  class  of  all  stationary 

iterations  without  memory  which  use  a linear  information  operator  31  per 

iterative  step,  i.e.,  8 * U$(31). 

31 

Which  properties  should  cp  have  to  be  called  a globally  convergent  itera- 
tion? To  motivate  our  definition  consider  first  the  problem  f(x)  ■ 0 where 
f is  defined  in  Df  * [x:  |x-ar|  < R(f) } and  a is  its  unique  simple  zero. 
Suppose  we  apply  cp  to  this  problem.  Let  r(f,cp)  be  the  maximal  number  such 
that  for  any  starting  point  Xq  satisfying  | xQ-Qf | < r(f,cp)  the  sequence 
xi+1  “ cp(x^,9l(f  ,x^)>  is  convergent  to  or.  Then  the  ball  (x:  |x-a|  < r(f,q>)3 
is  called  the  ball  of  convergence  of  cp  for  f.  Of  course,  r(f,cp)  depends  on 
R(f)  and  in  particular  r(f,q>)  £R(f).  Suppose  there  exists  a positive 
constant  c ■ c(cp)  such  that  r(f,cp)  * c R(f)  for  any  f.  Then  9 enjoys  a type 
of  global  convergence  since  the  ball  of  convergence  has  radius  proportional 
to  the  radius  R(f)  of  the  domain  D^.  However  for  problems  with  R(f)  ■ + “ 
we  get  r(f ,cp)  ■ + 00  which  means  that  any  choice  of  a starting  point  x^ 
yields  convergence.  This  seems  to  be  too  strong.  For  R(f)  * + • we  would 
like  to  have  r(f,cp)  large  but  not  necessarily  equal  to  infinity.  This  is 
the  motivation  of  the  following.  Let  K,L  be  two  given  constants  such  that 
K i 0 and  0 < L s + “.  Define  R^  * min[R(f) ,K| a|  + L}.  Now  the  existence 
of  a positive  constant  c ■ c(cp)  such  that  r(f,cp)  a c Rf  implies  a type  of 
global  convergence  cp.  This  discussion  shows  that  we  should  compare  r(f,ep) 


3.2 


If  f has  more  than  one  simple  zero  we  proceed  as  follows.  Let 
dist(a,dDf)  be  the  distance  of  a,a  6 S(f) , to  the  boundary  0Df  of  the 
domain  0^.  Define 

Rf(a)  - min{dist(cr,dDf) , k|  or)  + L},  (K  * 0,  0 < L * + ») . 

Let 

B(b,f)  - U [x:  |x-ar|  <b*R  (a)} 

a€s(f) 

where  b 2 0.  Note  that  if  S(f)  » {a}  then  Rf(a)  - Rf.  For  any  iteration  cp, 
«P  6 «(*).  we  define  a number  c(cp)  such  that 

(i)  for  any  f € 3 and  for  any  starting  point  xQ  6 B(c(cp),f)  the 

sequence  {x^,  xi+1  - 9(xj.;  ^(f.x^),  is  well-defined  and 

lim  x € S(f)  . 
i-»«  1 

(ii)  for  any  e > 0 there  exist  a problem  f € 3 and  a starting  point 

xQ  ^ B(c(cp)  + «,f)  such  that  either  the  sequence  [x^J  is  not 

well-defined  or  lim  x S(f).  ■ 

i-*w  L 

Note  that  for  any  iteration  c(tp)  6 [0,1].  The  set  B(c(cp),f)  is  a con- 
vergence domain  of  cp  for  the  function  f since  taking  any  starting  point 
Xq  € B(c(q>)  ,f)  we  get  convergence  of  (x^J.  Note,  however,  that  we  do  not 
specify  which  element  from  S(f)  is  the  limit  of  £x^ } . 

Definition  j.l 

We  shall  say  that  an  iteration  cp,  cp  € $,  is  globally  convergent  for  the 
class  3 iff 

c(q>)  >0.  ■ 


J 
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Definition  3.1  imposes  only  a weak  condition  on  cp.  However,  we  shall 
show  that  for  any  iteration  from  *,  c(cp)  - 0.  This  means  that  even  in  the 
sense  of  Definition  3.1  there  exists  no  globally  convergent  stationary 
iteration  using  linear  information  for  the  class  3. 
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4.  MAIN  RESULT 


Theorem  4 . 1 

No  iteration  cp  from  $ is  globally  convergent  for  the  class  3* 


Proof 


Suppose  there  exist  91:  and  cp  € $(9t)  with  c - c(cp)  > 0.  Let 


cL 


if  CK  * 1, 
if  cK  < 1. 


12(1-CK) 

Define  f(x)  - x-a.  Then  f € 3,  S(f)  * {a}  and  Rf(a)  - K|a|  + L.  Let 
xQ  - 0.  Since  x^  6 B(c,f)  * [x;  |x-a|  < cR^(a)},  the  sequence  {x^}, 
xi+1  " ^(f.Xj)),  tends  to  a,  a f 0.  Thus,  there  exists  a unique 

integer  k,  k £ 1,  such  that 


(4.1)  |x()|,|x1|,...,|xk_1|  <|  and  |xj  & |. 

Consider  a polynomial  w of  the  form 
n»k 

(4.2)  v(x)  - £ aiXi+1 

i-0 

which  satisfies 

(4.3)  9l(f-w,Xj)  ■ 3l(f,Xj)  for  j - 0,1,. ...k-l. 

This  is  equivalent  to  the  following  homogeneous  system  of  n»k  linear 
equations 
n*k 

(4.4)  2,  aiLs(xl+1*xj>  " 0 for  s - 1,2, ...,n  and  j - 0,1,. ...k-l. 
i-0 


4 


► .2 


Since  we  have  more  unknowns  than  equations , it  is  obvious  that  there 
exists  a non-zero  polynomial  w of  the  form  (4.2).  Then  there  exist 
positive  integers  r,  1 £ r ? nk+1,  and  p,  1 ip  i r,  and  non- zero 
z^^,...,zr  such  that 

w(x)  - xP(x-zp+1)*...*(x-zr). 

For  c > 0,  define 


fe  (x) 


^f (x)  + ~w(x)  if  |x|  < |, 

(^undefined  if  |x| 


From  the  general  theory  of  algebraic  functions  (see  for  instance  Wilkinson 
[63])  it  is  known  that  for  sufficiently  small  e there  exist  p simple 
zeros  X^(e) , . . . , Xp(e)  such  that 


(4.5) 


\(c) 


P’.f(O) 


w(p) (0) 


o(«*) 


where  is  the  i-th  complex  root  of  the  equation  xP  =■  s.  Note  that 

lim  X (e)  * 0,  Vi.  Therefore  for  sufficiently  small  e,  we  get  f 6 3« 
e-»0  * 

X,  (e)  »X  («),...  ,X(e)  6 S(f  ) and  lim  R,  (X  (e))  * min|-f,L}.  Then  the 
p £ e-0  1 1 

starting  point  yQ  ■ xQ  - 0 belongs  to  B(c,fg).  This  means  that  the 

sequence  {y^},  yi+1  • tp(y^ ; ®(fe,y1)),  is  well-defined.  Observe  that 

3l(fg,Xj)  ■ SF*(f ^ »yj)  for  J " 0*1 k- 1 and  yQ  - xQ.  Therefore 

yi+^  * xt+i  " ®P(*^5  3l(f,x^))  for  i ■ 0,l,...,k-l.  From  (4.1)  we  know 

that  |yk|  ■ |xjJ  which  means  that  y^  does  not  belong  to  the  domain 

Df  . Thus  v(fe»yk)  is  not  well-defined,  see  (2.2),  which  contradicts 

c(cp)  > 0.  , 


i 


4.3 


{ 
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Theorem  4.1  says  that  chere  exists  ao  globally  convergent  iteration 
without  memory  using  a linear  information  operator  for  the  class  3 °f  analy- 
tic complex  functions  having  only  simple  zeros.  This  negative  result  also 
holds  for  real  problems.  Let  3}  be  the  class  of  real  functions  f, 
f : Df  c R — R,  analytic  in  Df  and  having  an  unique  simple  zero.  Consider 
real  information  operators,  i.e.,  3t(f,x)  6 Rn,  vf  € 3j*  **  € D^. 

Theorem  4.2 

For  any  real  linear  information  operator  31  there  exists  no  iteration  ® 
from  5(91)  which  is  globally  convergent  for  the  class  3^ 

Proof 

Suppose  that  for  a real  linear  information  operator  91,  91:  -*  R°  and 

for  <p  € §(3l),  c » c(<p)  > 0.  Let  f(x)  ■ x-a  be  defined  as  in  the  proof  of 
Theorem  4.1.  Since  xQ  * 0 6 B(c,f) , the  sequence  {x^},  x1+1  ■ <p(x^;  3l(f,xt)) 
tends  to  a / 0.  Therefore 

(4.6)  Xl  - cp(0;  3l(f ,0))  j*  0. 

Consider  now  a real  polynomial  w, 
n 2 

(4.7)  w(x)  » 2,  aix  » 

i-0 

satisfying 

(4.8)  3l(f-w,0)  - 9t(f  ,0)  . 


The  equation  (4.8)  is  equivalent  to  the  following  homogeneous  system  of  n 
real  linear  equations. 


4.4 


(4.9)  £ alLs(xt+1,x())  for  s - 1,2,..., n. 


1-0 


It  Is  obvious  that  there  exists  a non-zero  real  polynomial  w of  the  form  (4.7) 
and  satisfying  (4.8).  Let  w(x)  - x^(x-z^^)  • . . . • (x-zf)  where  1 Sr  * 2n+l, 

1 £ p '*  r and  ^ 0 for  i - p+l,...,r.  * Due  to  (4.7)  p is  odd. 

Define 

flxll  IVll  l*rU 

«ln{— ^ if  p < r, 


r ■ 


and 


fe(x) 


otherwise, 

ff(x)  + “w (x)  if  |x|  < r, 

I undefined 


if  x ^ r 


for  e > 0.  For  sufficiently  small  e,  the  solutions  of  fg(x)  - 0 in  the 

complex  plane  are  given  by  (4.5).  Since  p is  odd,  only  one  of  X^c)  in 

(4.5)  is  real.  Thus,  f has  a unique  simple  real  zero,  say  X(c) . Since 

€ 

X(e)  tends  to  zero  with  e,  lim  R,  (\(e))  - min{r,L}  and  xft  - 0 £ B(c,f  ) 

e—0  c 0 c 

for  sufficiently  small  e.  Therefore  the  sequence  [x± } , x j ^(f^x^)) 

is  well-defined.  Observe  that 

xL  - cp(0;  5l(fc,0))  - cp(0;  3l(f,0)). 

Due  to  (4.6)  x^  £ Df  which  means  that  X£  is  not  well-defined.  This 
contradiction  ends  the  proof.  ■ 
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5.  THE  GENERAL  CASE 

In  Section  4 we  showed  that  there  exists  no  globally  convergent  one- 
point  stationary  iteration  without  memory  which  uses  linear  information. 

In  this  section  we  prove  the  same  result  for  multipoint  Iterations  with  or 
without  memory. 

Let  L, ,L„ , . . . ,L_  be  functionals  defined  as  in  Section  2.  Then  a multi- 
i l n — 

point  linear  information  operator  31:  c H X (L  -*  <E°,  is  defined  as 

(5.1)  3t(f,x)  - [L1(f,21),L2(f,22),...,Ln(f,zn)],  Vf  € H,  Vic  6 Df 
where 

(5.2)  zx  =■  x and  zfc+1  *5^(2^  Lj(f  .Zj)  ,L2 (f  ,z2)  , . . . .L^f  ,zfc))  , k - 1,2 n-1, 

for  certain  functions  §2 ,?3> . . . ,§n.  Note  that  if  - x,  k ■ 2,...,n,  then 
31  is  a one-point  linear  information  operator  defined  in  Section  2. 

For  given  integer  m,  let  xq»x_j » • • • >x_m  be  distinct  approximations  of 
a solution  of  f(x)  ■0,  f € Suppose  we  construct  a sequence  of  approxima- 
tions by  the  formula 

(5.3)  * 9(x£ >xj_  j i • • • »x^_m5  jX^)  »^(f  »x^ ^)  , . ..  ,5t(f  ^x^^)) 

where  9:  c d,(m+’^)  (“+!)  _ (E  is  a functional.  Then  9 is  called  a multi- 
point stationary  iteration  operator  with  memory  if  m ^ 1 and  without  memory 

I 

if  m * 0 using  a linear  information  operator  31.  For  brevity  9 is  also  called 

an  iteration.  Let  $ (31)  be  the  class  of  all  such  iterations, 
m 

For  particular  31  and  m we  get  commonly  used  iterations.  For  instance, 
m * 1,  3l(f,x)  * [f(x)]  and 
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1 


i 


1 

) 


i 


cp(x,y;  M(£,x)  ,3l(f  ,y) ) - x - j -£Y (y)  f (x) 


is  the  secant  iteration.  An  example  of  two-point  stationary  iteration  with- 
out memory  is  provided  by  Steffensen  iteration  (see  Steffensen  [33])  which 
is  defined  as  follows 


* [f  (Zj)  ,f  (z2)  ] where  « x and  z 2 - z^-f^) 


and 


co(x;  3l(f ,x) ) » * - 


*r*2 


1 ■ f (zx)-f (z2)  f(zl)- 


We  extend  the  definition  ot  global  convergence  as  follows.  Let  be  a 

one-  or  multipoint  linear  information  operator  and  let  m be  an  integer. 

Recall  that  B(b,f)  is  defined  in  Section  3.  For  any  iteration  cp,  cp  £ $ (*jt) 

m x 

define  c * c(cp)  as  a number  that 

(i)  for  any  f 6 3 and  any  choice  of  distinct  starting  points 
xq»x_^» • • • ^rotn  B(c,f)  the  sequence  {x^}, 

xi+l  * Cp<xi»xi-l***-*xi-m;  :R(f*xi>’,!l(f*xi-l)»-*-»3l<f«xi-m)) 
is  well-defined  and  lim  x 6 S(f) . 

i-.®  1 

(ii)  for  any  c > 0 there  exist  f 6 3 and  distinct  points 

x0,x_i* • • • *x-m  ^ B(c+e,f)  such  that  either  the  sequence  £x^] 
is  not  well-defined  or  lim  x.  £ S(f). 

i-.«o  i 


Definition  5.1 

We  shall  say  that  an  iteration  cp  is  globally  convergent  for  the  class  3 iff 


c(®)  >0 


4 


5.3 


Now  let  5 be  the  class  of  all  stationary  Iterations  with  or  without 
memory  which  use  a linear  Information  operator  51,  i.e.,  $ * yu  »„<*>• 

Theorem  5 . 1 

No  Iteration  cp  from  5(31)  is  globally  convergent  for  the  class  3* 


Proof 

Apply  the  proof  of  Theorem  4.1  with  starting  points  x-j  ■ . J min[a»L3, 
j ■ 0,1,..., m,  and  with  n k in  (4.2)  replaced  by  n(nn-k) . ■ 

Theorem  5.1  says  that  knowing  only  the  value  of  a finite  number  of 
linear  functionals  on  f it  is  impossible  to  find  a globally  convergent  sta- 
tionary iteration  for  the  class  3*  Therefore  if  we  want  to  solve  f(x)  ■ 0 
by  a stationary  iteration  we  have  to  assume  that  the  starting  points  are 
sufficiently  close  to  a solution.  By  contrast  it  is  known  that  for  some 
non-linear  information  operators  there  exist  globally  convergent  stationary 
iterations.  An  example  is  provided  by  Laguerre  iteration.  Also  for  linear 
information  operators  there  exist  globally  convergent  non- stationary  itera- 
tions for  the  class  3*  An  example  may  be  found  in  Traub  and  Wozniakowski  [76] 
where  global  convergence  of  the  sequence  of  interpolatory  iterations  1^  is 
proved.  For  this  case,  the  k-th  iteration  requires  the  knowledge  of  k linear 
functionals  of  f.  Furthermore  there  exist  globally  convergent  non- stationary 
iterations  which  are  based  on  the  use  of  increasing  size  of  memory.  This 
will  be  reported  in  Wasilkowskl  [79]. 


6.1 


6.  FINAL  COMMENTS 

In  Section  5 we  showed  that  no  stationary  iteration  using  linear  informa- 
tion is  globally  convergent  for  the  class  of  analytic  problems  having  simple 
zeros.  The  existence  of  globally  convergent  iterations  depends  on  the  class 
3 of  functions  whose  zeros  we  want  to  approximate.  For  some  simple  classes 
there  exist  well  known  globally  convergent  stationary  iterations  which  use 
linear  information.  For  example  if  3 is  the  class  of  real  functions 
f:  R -•  R whose  first  derivative  is  monotonic  then  Newton  iteration  is 


globally  convergent. 

For  many  interesting  classes  the  existence  of  global  convergent  itera- 
tions is  unknown . Even  for  the  class  II  of  all  real  polynomials  with  simple 
real  zeros  this  problem  is  open.  All  known  globally  convergent  iterations 
for  the  class  II  are  either  non-stationary  or  use  nonlinear  information.  For 
example  Newton  iteration  with  a suitably  chosen  starting  point,  Bernoulli's 
method  and  Laguerre  iteration  are  globally  convergent  for  II.  See  for 
instance  Ralston  and  Rabinowitz  [78].  Either  implicitly  or  explicitly  these 
iterations  use  the  degree  k of  the  polynomial  whose  zero  is  desired. 

Note  that  the  degree  k is  nonlinear  information.  Indeed,  suppose  there 
exists  a function  g (in  general  nonlinear)  such  that  k * g(x;  3l(f,x))  where 
31  is  a multipoint  linear  information  operator.  For  any  x^  there  exists  a 
polynomial  w of  degree  greater  than  one  such  that  3l(w,xQ)  * 0.  Taking 
fg(x)  ■ x + w(x)  we  get  3l(f£,Xg)  ■ 31(x,Xq)  and  f £ € II  for  sufficiently 
small  «.  Therefore  g(xQ,3l(x,XQ> ) * g(xQ,3l(f  £,Xq) ) , but  the  degrees  of  the 
polynomials  x and  fc(x)  are  different.  This  contradicts  the  assumption 
k * g(x;  3l(f,x)),  with  31  linear. 
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6.2 


i 


We  believe  that  any  globally  convergent  iteration  for  II  has  to  be  non- 
stationary or  use  nonlinear  information.  Therefore  we  propose  the  following 
conjee ture. 

‘ 

Conjecture  6.1 

There  exists  no  globally  convergent  stationary  iteration  using  linear 
information  for  the  class  of  all  real  polynomials  with  simple  real  zeros.  ■ 
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